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Abstract 

The theory of L^-spectral gaps for reversible Markov chains has been 
studied by many authors. In this paper we consider positive recurrent 
general state space Markov chains with stationary transition probabili- 
ties. Replacing the assumption of reversibility by a less strong one, we 
still obtain a simple necessary and sufficient condition for the spectral 
gap property of the associated Markov operator in terms of isoperimetric 
constant. Moreover, we define a new sequence of isoperimetric constants 
which provides a necessary and sufficient condition for the existence of a 
spectral gap in a very general setting. Finally, these results are used to 
obtain simple sufficient conditions for the existence of a spectral gap in 
terms of the first and second order transition probabilities. 

1 Introduction 

Let ^1 , ^2 , ■ • ■ be a time discrete and time homogeneous positive recurrent Markov 
chain on an arbitrary state space (f2, J-) with transition kcrnclp(-, •) and uniquely 
determined invariant measure tt. The main question addressed is the existence 
of an L^(7r)-spectral gap. We are interested in conditions that ensure 

lim sup ||P"/||f<l, 

where 

Pf{x) ■■= f fiy)P{x,dy), feL'in) 
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and i(7r) {/ e L^{n) : f{x)7T{dx) = 0, f{xf7r{dx) = 1}. 
For reversible Markov chains, simple conditions equivalent to the spectral gap 
property are known in the time discrete case [TH] as well as in the time con- 
tinuous case [1], [5], [B], [7], [H], [II]- These conditions are given in terms of 
isoperimetric constants [1], [5], [B], [TT], [12], [IS] or in terms of geometric con- 
stants [7|- So far, without the assumption of reversibility, only a few results 
under very strong conditions are known [12j . There are mainly two reasons 
for this: First, non reversibility implies that Dirichlet form techniques can only 
be successfully applied by using certain reversibilization procedure (e.g. [TB] , 
0J [H])- But then one only obtains information about the real part of the 
spectrum. The second problem is that there is no canonical generalization pro- 
cedure. Since reversibility corresponds to the self-adjointness of the associated 
Markov operator P, one first might try to generalize the results obtained in 
[18] to normal Markov operators. We will show by example that in general this 
approach won't be successful. In order to tackle the problem, we compare the 
isoperimetric constant associated to with these associated to P*P and PP* 
(where P* denotes the adjoint of P). This technique turns out to be appropriate 
to study spectral gap properties of P in the non-reversible case if the Markov 
chain satisfies a condition that is much weaker than reversibility, but is at least 
related to the latter and is called very weak reversibility for that reason. In 
fact, this method enables us to prove Theorem |21 which generalizes the results 
obtained in [IS] and can be seen as the core of this paper. Moreover it is possible 
to use the theory developed in this paper to obtain estimates for spectral gaps 
of non-reversible Markov chains. 

Let us introduce the basic notations and recall some known facts. Unless 
stated otherwise, we consider a positive recurrent time homogeneous Markov 
chain ^i, ^2, • ■ ■ with arbitrary state space {Q, transition kernel p{x, dy) and 
uniquely determined invariant probability measure tt. We say that the chain 
^1, ^2, ■ • • is reversible, if for all A, B ^ T 



QiAB):^ / 7:idx) / p{x,dy)^ / 7:{dx) / pix,dy) = Q{B, A) =: Q{A, B), 
Ja Jb Jb J a 

so Q, Q are measures on ft^. Alternatively, reversibility can be stated as 

^{x,y) = 1, Q a.s. 
dQ 

In order to give a natural generalization of this definition, let us, for simplicity, 
assume that Q and Q are equivalent measures in the Radon-Nikodym-sense. 

Definition 1 We say the Markov chain ^1,^2,- ■• is weak reversible of order 
n £ N if there exists C G [1, 00) such that 

i < ^ < C, Q(") a.s., 

where Q^"\A,B) := 7r(da;)p"(x, S) and Q(") (^, B) = Q(") (B, A). 
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For C = n = 1 this is exactly the definition of reversibihty. 

The definition above can be generahzed to 

Definition 2 We say the Markov chain ^i,£,2,-- - is very weak reversible of 
order n G N i/ there exists q Cz {1, oo] such that 

esssupy^^W ^(•,y)||L,(p(j^^.)) < cx) na.s. (1) 

From the definition it is immediately clear that weak reversible Markov chains 
are very weak reversible, but in general the converse is not true. 

In the sequel we will need the following families of isopcrimetric constants: 

kn := inf fc„(A), kn{A) := , . . / A^)7r(dx), neN, 

and 

fcp..p„ inf fcp..p„(A) inf - / P*'' P^Xa^x^x), 

Aer AeF 'k[A)'k{A'^) J A 

where P* is the adjoint operator of P considered on i^(7r). 

In [T^ we saw that aperiodicity of the Markov chain , ^„+i , . . . can be measured 

by the constants 

Kn sup fc„(A), neN. 
Aer 

We call an operator P positive if Pf > for all / > 0. One can show that there 
exists a measure /i on fi^ such that for all /, g € L'^i'^) 

<f,P*Pg>^:^ f f{x)P*Pg{x)7r{dx)^ f f ii(dx,dy)g{x)f{y). (2) 
Jn Jn Jn 

From this, we obtain that 

< /, (Id - P*P)g >.= \l I (giy) - gixmfiy) - f{x)Udx, dy) 

and therefore especially 



n Jn 



< f, {Id - P*P)f >.^\j I (/(y) - f{x)ffi{dx, dy). (3) 



n Jn 



This representation will be used in the proof of Theorem [H 
If we replace P*P by an arbitrary positive and self adjoint operator A, a rep- 
resentation as in ([3]) holds true, provided that the according probability space 
{Q,J^,n) satisfies some weak conditions (see [13]). 

The spectrum cr{P) of P may be divided into three disjoint components, 

a{P) = ap{P)Uc7ciP)UariP), (4) 
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where (Jp{P) is called the eigenspectrum (or discrete spectrum), (Tc{P) the con- 
tinuous spectrum and ct^ (P) the residual spectrum. The approximate spectrum 
f^apiP), which is defined to be the collection of complex numbers which satisfy 

hm ||(P- A/d)/„|| ^0 (5) 

n — -too 

for some sequence (/„) with ||/„|| = 1 for all n e N. It is well know that 

ap{P) U a,{P) C aap{P) C a{P) (6) 

and in the case where P is normal (i.e. P*P ~ PP*), it holds (see [T]) 

apiP) U ac{P) = aap{P) - a{P). (7) 

Remark 1 The definitions of kn and Kn are taken from \18^, that of weak 
reversible, very weak reversible and kp*'^ pn appears to be new. 

2 Spectral theory for general and weak reversible 
Markov chains 

Let us start with the following, probably well-known Proposition: 

Proposition 1 Let ■^1,1^2, •■ • be a positive recurrent Markov chain. Then the 
following two statements are equivalent: 

1. P has an L'^{-k)- spectral gap. 

2. 

3no e N : fcp."op„o > 0. (8) 

// is satisfied, we obtain the following estimate for the spectral radius r of P 
on Ll^^i-n): 



a{P) C Br{Q) {a; e C : ||a;||2 < r}, r = 




no as in 0^ 

At the end of the paper we provide an example where this can be used to decide 
whether the operator P has an L^(7r)-spectral gap or not. 

The next theorem provides a necessary and sufficient condition for the existence 
of an L^(7r) -spectral gap. The interesting fact is that only one isoperimetric 
constant is needed in order to establish the existence of a spectral gap: 

Theorem 1 Let us assume that ^1,^2, . ■ . is very weak reversible of order n. 
Then the following two conditions are equivalent: 

1. P has a L'^ij:)- spectral gap. 
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2. k2n > 0. 



Now let us state the main theorem of this paper: 

Theorem 2 Let us assume that ^1,^2, ■ ■ ■ is weak reversible of order n. Then 
the following three conditions are equivalent: 

1. P has a L'^ij:)- spectral gap. 

2. k2n > 0. 

3. 0< kn < Kn < 2. 

We see here that under the assumption of weak reversibihty the isoperimetric 
constants fc„ and K„ are stih an appropriate tool for analyzing the existence 
and the size of a spectral gap. This shows that the operator P may be far away 
from being reversible, but the concept of isoperimetric constants can still be 
applied in order to obtain estimate for the spectral gap. Note that for n — I, 
Theorem [5] improves the result in [18] . where reversibility is assumed. 
In order to state the next theorem, we need to introduce the following notations: 
Let An E J- he such that lim„^oo fc2(^n) ~ ^2- Without loss of generality we 
may assume that 7r(A„) < i. Let 7r^(B) := ^^^^^F fA^ix) := p^^^A^^ ■ 
Assume that there exists p € (l,oo] and a sequence An as above such that 

sup ||lA„/A„||LP(7r^„) < 00. (10) 



Theorem 3 Let ^i,^2,--- &e a very weak reversible Markov chain such that 
1110\) holds. Then ^1, ^2, • • ■ has a spectral gap if and only if 

k:=ki> 0. (11) 

Now we should have a closer look at the assumption ^TU\i . Let us consider an 
e-lazy Markov chain, i.e. a Markov chain that satisfies 

p{x,x)>e (12) 

for an e > and all x £ il. Then we have that fA„ < 7 and so pil)) is trivially 
fulfilled. But in fact, for MCMC simulations condition (fT^ is often satisfied or 
the chain can be defined in such a way that (fT^ is satisfied (see e.g. [2]). For 
example, it is often assumed that p{x, x) > | in order to have TZ{a{P)) > 0, i.e. 
all values in the spectrum of P should have a non negative real part. Another 
advantage of the Theorem[3]is that it is possible to give lower bounds for the size 
of the spectral gap by combining it with Proposition [1] Lemma [T] and Lemma 

m 

Let us state the next theorem, which is closely connected to Theorems 2.1. 
and 2.3. in [16]. 
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Theorem 4 Let , C2 , ■ • ■ be a positive recurrent Markov chain such that for P 
we have that aap{P) — cr{P). Moreover, let us assume that 

p + p*-p*p (13) 

is a positive operator. Then, for the spectrum cr[P) of P acting on Lq i{Tr), we 
obtain that 

aiP)f]B^^Al)^9. (14) 

where k denotes the constant introduced in U6] /. // in addition P is assumed to 
be self adjoint, we obtain 

a{P)ci[0,l^^k% 

Here it is interesting that we obtain a sufficient condition for the existence of a 
spectral gap in terms of k without using any reversibiUty assumptions on p. 

Under certain conditions it is possible to compare this with the results 
of Lawler and Sokal [TB]. To this end let us remark that the result above 
with slightly modifications can be proved for positive recurrent continuous-time 
Markovian jump processes in the same way replacing p{x, dy) by dy)lx=^y, 
{Id-P)f by Jf := S^]{x,dy)l,^y{f{x) - f{y)), m by 

J + J* — J* J to be positive and fc^ by kj^j*^j-j. Here j is the transition 
rate function corresponding to the jump process. In the continuous time case 
theorem 2.3. in Lawler and Sokal [16] states that for reversible Markov chains 
it holds 

n(a(J)) > -^fc^ 
" - 8M 

Our result states that under the additional assumptions of cr(P) — aap{P) and 
positivity of J + J* — J* J one can skip the reversibility assumption to obtain 

This implies that the size of the gap decreases asymptotically with rate for 

M — > cx), which is substantially slower compared to and therefore improves 
the results obtained in ^ and ^16j for reversible Markov chains in that direction, 
provided kj+j*^j*j > . 

For reversible Markov chains, equation (|13p can be expressed in terms of the 
transition probabilities and is equivalent to 

2p(x, •) -/(a;,-) > TT a.s. (15) 

Moreover, from the spectral mapping theorem it follows that (fT3|) implies 

(j{P) C [1 -\/2,l]. 

These considerations provide the framework where Theorem [4] can be applied. 
Using (fT5|) it is easy to see that for reversible chains with countable state space 
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the condition ([T^ can only be satisfied for Markov chain which enters from every 
starting point every other point of the state space with positive probabihty. 

The following observation will show why it is interesting to consider weak 
(very weak) reversible Markov chains of higher orders: 



P = 1 . (16) 




The invariant probability measure tt is given hy tt — {j, j, One can check 
that 






Since P*P is not ergodic, fcp.p — and hence it follows from Lemma 4 of [18] 
that fc(p.p)»i = Vn G N. But of course, this chain has the spectral gap prop- 
erty, which will be obvious by considering fcp.2p2 

The problem is that without any restrictions on the transition probabilities, 
deterministic set movements of order larger than 2 are possible. We will see 
that the weak reversibility property excludes such behavior and will facilitate a 
comparison between ^2 and kp*p, kpp-. 



3 Proofs of the theorems 

Let us start with the proof of Proposition [1] Proof: Since p*" p^^ ig positive 
and self adjoint and since ([2]) is satisfied, we can use the proof of Theorem 2.1 
in [16]. Therefore we obtain for all f G Lq i{tt): 

^kl^.p^ < inf < fJ~P*'>"f >2< Ap."p.. 
This is equivalent to 

^jl-^kl,^p. > I \PV\\2 > Vl-fcp-P", (17) 

It is not difficult to see that for all n in N we have that 1 — fcp."p„ > 0, so the 
right hand side of ([TT)) is well defined. But from this inequality the necessity of 
dH]) follows. 

On the other hand, if ([5]) is fulfilled for some uq G N, we obtain by using the 
left hand side of inequality p?)) 

||pnon||^ < ||p"0||n < (^^ 1 _ ^fc^ ^ , 

Having in mind that ||/'"||2 is monotonic decreasing in n the desired estimate 
follows by taking the non-th root. 
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□ 

Lemma 1 We consider the Markov chain ^1,^2, ■• ■• The following inequalities 
hold: 

fcp."op,.o < 2^/^esss«Pj^goll^(->y)llLp(pto,-))fc2«o (1^) 

k2no < 2^/PeSSSMp,ygoll^(-:y)llL!'(pfe,-))^p-oP*"<>- (^9) 

Proof: Without loss of generality we can assume that wiA") > i. The first 
inequality can be seen as follows: 

n{A)7r{A'')kp.p{A) = [ P* PlA'=ix)TT{dx) ^ [ pix, A)p{x, A'')n{dx) 

J A Jn 

= n{A) f f ^i,,y)pia:,A^)^p{y,dx) 
Jn J A dQ 7r(A) 



< 7r(A) 



§^[x,yY^-^piy,dx) 
dQ 7r(A) 



p{x,Ay^p{y^dx) 



lA dQ 

< 7r(v4)7r(A^)2^esssupj^gj,||^(-,y)||iP(j,(y,.))fc2(A)i 

(20) 

Let us turn over to second inequality: 



■K{A)-K{A'')k2{A) = 7r(A)7r(A'=)fc2(A'=) = / P*lAc(x)FlA(x)7r(dx) 

= 7r{A) f f P*U^{x)p{x,dy)^^'^''^ 
Jn J A 



< 7r(A)esssup gf^||^(-,?;)||Lp(p(j,,.)) ( /" ( P*lA'={xyp{y,dx) 

dQ \Ja Jn 

< 7r(yl)7r(A'=)2pesssupygf;||^(-,y)||LP(p(j^,.))fcpp.(A)i 



□ 

From here we start the proof of Theorem [TJ That the existence of an uq 
with k2no > is necessary was shown in |18| . Assume now that there exists 
no such that fc2no > 0. Then we have by Lemma [1] and weak reversibility that 



kpnop,"o > 0. From Theorem [T] we obtain that P* has a spectral gap. But it 
is well-known that <t{P) ~ (j{P*). So this implies that P has an L^(7r)-spectral 
gap. 

□ 

Corollary 1 Assume that ■^1,^27 •■ • is a weak reversible Markov chain of order 
Uq with reversibility constant C . Then we obtain the following estimates: 

fcp."op"o < Cferio) feno < Ckp,^gp,'^o (22) 

Proof: Use Lemma [T] and choose p — oo, q — 1. 

□ 

Corollary 2 Let us assume that , ^2 , • • ■ is a weak reversible Markov chain 
and that the transition kernel of the reversed Markov chain i C2 1 ■ ■ • given 
by p*{-, •). Then we have the following inequalities: 

— — > fcp...op„o > 2^l-Pesssup^^\\'H^{-,x)\\p^p(^^^.)klil 

2^/Pesssupy^^\\^(:,x)\\l^^^,^ dQ 

(23) 

Proof: The first inequality is obtained by changing the roles of P and P* in 
the proof of Lemma [1] 

□ 

For proving Theorem[21 we have to establish the following important Lemma: 

Lemma 2 Let ^1 , ^2 , ■ • ■ be a stationary and weak reversible MC of order n on 
an arbitrary state space {Q, J-, tt). Let Cn be the reversibility constant associated 
to the MC. Then we obtain the following estimate for k2n ■ 



km > sup 



{l-e)Kn l-ej 1-e 



(24) 



The Lemma [2] is closely related to Lemma 6 of [18 in the way that the 
assumption of reversibility is replaced by weak reversibility. Fortunately, the 
proof given in [18j is somehow stable under the milder condition of weak re- 
versibility. This abbreviates the proof and we present only the part where weak 
reversibility is needed. 

Proof: Without loss of generality let us assume that n = 1 (otherwise 
argue with p"(-, •) instead of p(-, •)). As in [THj one can show that without loss 
of generality we can choose A d such that tt{A) < i. Let us consider the 
following sets: 

A.:^{y€A: p{y, A^) > C := Al n A, 

4 44 
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B,^ := {x e Ak : p{x, A'^) < 1 ~ ei}, 

As in [TS] we distinguish three cases. The estimates obtained there for the first 
and the third case are vahd without the assumption of reversibiUty. So let us 
remind the estimates obtained in jl8j : 

Case 1: ^ 

k2iA)>^dA toY7T{C)>6An{A). 
16 

Case 3: 

•(2-e)(l-ei)(l-e2)(l-(5A) 1 



k2{A) > e[k 



{l-e)K l-ej 1-e^ 
for 7r(C) < dATriA), t:{B,^) < e27r(A|). 

(25) 

The second case differs from that in [18], so let us assume that 7r(C) < 6att{A) 
and an €2 > exists such that 

7r(B,J > e27r(A|). (26) 
With these assumptions it follows that 

= (a^\ac^ I <dx)p\x,A^)> / 7i{dx)p\x,A^) 

- (A\^tAc\ / '"('^^) / Pix,dy)p{y,A'') 
TT A 7r(A'= Jb, J a, 

^ L(A)!r(A^) /^, > ^ ^^AMA'^J j(dx)pix,BA^). 



(27) 



Moreover, we have 
1. 



TT{dx)p{x,C) < Cr / n{dx)p{x,B,,) < Crtt{C) < CRSAiriA). 



2. 

/ Tr{dx)p{x,A) > ei7r(B,J > eie2TT(Ak) > £162(1 - (5yi)7r(A). 
Subtracting the first inequality from the second we obtain 

TT{dx)p{x, Ak) > (£261(1 - Sa) - CR6A)n{A). 
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This inserted into ([77|) yields 



fc2(A)> -^(£261(1 -<5a)-Ck(5a). (28) 



Now gluing the three cases together yields 



> sup min 

(5,ei,e2,c6K+ 



(2-6)(l-ei)(l-e2)(l-^) 1 



(1 - e)A' 1-eJ 1-e 

This proves Lemma [21 



(29) 



□ 



Theorem [2] follows now from Theorem [T] and Lemma [5J since the right hand 
side of ([Ml can be bounded from below if < fc„ < if„ < 2 (see |18|). 



In order to prove Theorem [3l we should establish the following lemma. 

mma 3 

inequality: 



Lemma 3 For all p e [1, oo] and q such that ^ + ^ = 1 we have the following 



2 sup„gN l|lA,.M„|lip(^^^) 

Proof: If sup„gpj ||lA„/A,J|Lp(7r^„) = oo, ([50)1 is trivially satisfied. So we 
may assume that sup„gN ||1a„/a„||^p(^^^) < oo . 

' - ^(a„)1(a;^) X/""^")^'^"'^"^"^'"^ 

- /^"(^)''^-4(da;)y (^^ /(x,4^J%^(dx) 

1 i 

< 1 SUp||lA„/A„||LP(7r^„)fc2 ■ 

7r(A'=)p neN 
From here we obtain 

^2 > '^(^^) " — — nT-T-iT^ ^ ( o ) " — iir—f-iw 



SUp„gp,||lA„/A„|lip(^^_j 2 SUp„gN||lA„/A„|lip(^^^) 



□ 



Now Theorem [3| follows immediately from Theorem [l] Lemma [3| and (|10p . 
As a consequence of Corollary [T] and Lemma [3| we obtain 

Corollary 3 Let ^1,^2, •■ • be a weak reversible Markov chain of order 1 with 
reversibility constant Cr and assume that we have that 
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1. k>0 



vix -A) 

'^^P 21 ' A\ < C'oo < OO TT - a.s. (31) 

A^r:Tv(A)>^ P (.2;, A) 
Then, for the spectrum (t{P) of P on Lq 1(7^), we obtain 

a{P) C B ._^^,. (0)- (32) 

Proof: From inequality ()3ip we obtain that from Lcmma[3]with p = 00, g = 1 
it follows that k2 > Moreover, by Corollary [T] we see that fcp.p > But 
this yields for all / £ Lq i{t:) 

<Pf,Pf>^ = l-<f,{Id-P*P)f>^<l-'^kl,p 

K 

< 1 



The claim follows now from the fact that r{P) < \\P\\, where r{P) denotes the 
spectral radius of P on Lq iC"")- 

□ 



4 Reversibilization procedures 

We saw that in order to get information about (t(P) of P, different procedures 
can be used: Choose a "suitable" function h and consider the following expres- 
sion: 

<f,{Id-h{P,P*))f>^, feLl.in). (33) 

Here, suitable means that h{P,P*) should at least satisfy the following condi- 
tions: 

• h{P, P*) should be self adjoint and positive 
• 

< /, {Id - h{P, P*))f >x> 0, / e Ll.iir). 

The first condition allows a representation of (|33p as seen in [31 This, together 
with the second condition can be used to estimate the spectrum a{h{P, P*)) of 
h{P,P*). Of course, h must be chosen in such a way that information about 
a{h{P, P*)) can be used to get estimations for cr{P). Essentially, the functions 
h that have been used in the literature so far are given by 

hi{P,P*) = ]^{P* + P) h2iP,P*) = P*P. 

(see for example ([16;) and ([10]). By definition, hi{P,P*) and /i2(F,P*) are 
self adjoint. For /ii(P,P*) we have that < f,{Id - hi{P,P*))f >^= 



12 



f,{Id — P)f >Tr). Since k — ki^^i^p^p*), this reversibihzation yields immediate 
information about the real part of cr(P) in terms of k [16]. 
As already seen in the weak reversible case, we use h2{P,P*)- Compared to 
hi{P,P*), the associated isoperimetric constant has the disadvantage that it 
cannot be immediately related to k. On the other hand, we show that in some 
cases we are able to compare it with ^2 and vice versa. Since h2{P,P*) is 
positive, this yields immediately in addition a global spectral gap property and 
not only a spectral gap property at one. 

One may ask if there are other reasonable functions h yielding sharper estimates 
for the spectral gap than that considered above. It seems to be that there 
are different possibilities for choosing h in order to obtain good estimates for 
(t(P). But in these cases we have to put stronger assumptions on the transition 
probabilities. To make things precise, let us prove Theorem |4l 

Proof: Since we assumed P + P* — P*P to be positive, we can use the 
proof due to Lawler and Sokal to obtain for all / G Lq ^{tt) that 

< {Id - P)f, [Id - P)f >,=< /, {Id -{P + P*- P*P))f >^> ^kl+p,^p,p. 

(34) 

This implies that 

||(W-P)/||2 > y|fcp+P*-p*p V/eP^ i(^). 

Moreover, we have that 

\\{Id-P)f\\2 < \\XId{f)\\2 + ||((1 - X)Id - P)/||2. 

This yields 

||((1-A)W-P)/||2 >0V A: \X\< ^kp+p,^p,p. (35) 

This implies that for all |A| < y/^kp+p^-ptp we have that A G (Jap{P)- Since 
we assumed that a{P) — <Tap{P) we obtain by the spectral mapping theorem 
that B nr belongs to the resolvent set of P. 
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It remains to show that kpj^p- ^p* p > k . This can be seen as fohows: 
kp+p,_p.p{A) = ——^——( p{x,A'')TT{dx)+ p{x,A)TT{dx) 



7r(A)7r(yl=) 

p{x, A)p{x, A'')TT{dx) 
1 



7r(A)7r(^=) 



p{x,A''yTr{dx)+ / p{x,AyTr{dx) 



1 / I f 

p{x, A)TT{dx) 



Tr{A) V^(A-) Ja^ 

= k{Ar. 

(36) 

□ 

Let us return to Proposition [T] and use it to check whether the underlying 
Markov chain has a spectral gap or not. Let us consider 

Example 1 We consider the Markov chain ^1,^2, ■ • ■ with state space il given 
by 

n = {0} U {(a, 5) : a > 1, 6 e {1, 2, . . . , a}}. 

The dynamics of the Markov chain is given by the following transition kernel: 

p((a, b), (a, b-l)) = 1, for b > 2, p{{a, 1), 0) = 1, 
p(0,0) i and 



p(0,(a,6)) = 



2-(°+i) : a^b 

: otherwise 



One can show that the invariant starting distribution n is given by 7r(0) = ^ 
and 7r((a, b)) = 2-"+^ for 6 e {1, 2, ... , a}. 

Since p* p"'{{3n,2n), (3n,2n)) — 1 Vn G N, it follows from Theorem]^ that P 
has not the spectral gap property. 

Remark 2 The example above is due to Hdggstrom 115], who used it to show 
that for geometrically ergodic Markov chains ^1,^2, ■ • finiteness of the second 
moments of a function h does not ensure the validity of a central limit theorem 
for the sequence h o h o ^2, ■ ■ ■■ 
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